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WTra CLAIMS : 

The status and content of each claim follows: 

1 . (previously presented) A method for generating a selectable perspective view 
of a portion of a hemispherical image scene, comprising the steps of: 

acquiring an omnidirectional image on an image plane using a reflective mirror that 

satisfies a single viewpoint constraint and an image sensor; 

defining a perspective viewing window based on configuration parameters; and 
mapping each pixel in the perspective window with a corresponding pixel value in the 

omnidirectional image on the image plane using a look-up table based on the configuration 

parameters. 

2. (original) The method of claim 1, wherein the configuration parameters 
defined in the defining step include at least one of a zoom distance defined as the distance 
from the focal point of said reflective mirror to said window, a pan angle defined as the angle 
between the x axis and a line through the focal point of said reflective mirror perpendicular to 
the x-y plane and a tilt angle defined as the angle between the x-y plane and a vector normal 
to said window. 

3 . (original) The method of claim 2, wherein the defining step is conducted 
via a user interface through which a user enters data corresponding to at least one of a desired 
zoom distance, pan angle, or tilt angle. 
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4. (original) The method of claim 1 , wherein the mapping step includes the 

step of generating a mapping matrix by: 

applying a ray tracing algorithm to each pixel in the perspective viewing window to 

determine a corresponding reflection point on the reflective mirror; and 

projecting each reflection point to a focal point of the image sensor to determine the 

corresponding location in the omnidirectional image on the image plane- 
s' (original) The method of claim 4, further comprising the step of storing 

the mapping matrix in a module having a memory. 

6. (original) The method of claim 1 wherein the step of defining a 
perspective viewing window defines the perspective viewing window as a panoramic viewing 
window. 

7. (original) The method of claim 1, further comprising the steps of: 
calculating a residual image based on a difference between a reference 

omnidirectional image and a sequential omnidirectional image; 

determining if the residual image contains any value that exceeds a predetermined 
threshold; and 

classifying any value that exceeds the predetermined threshold as an anomaly. 

8. (original) The method of claim 7, further comprising the steps of: 
calculating the configuration parameters for the perspective viewing window from the 

anomaly; and 
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selectively focusing the perspective viewing window on the anomaly using the 
calculated configuration parameters. 

9. (original) The method of claim 7, further comprising the step of 
activating an alarm if at least a portion of the residual image exceeds a predetermined 
threshold. 

1 0. (original) The method of claim 1 , further comprising the steps of: 
detecting a location of a sound source in the image scene; and 

adjusting the perspective viewing window based on the detected location of the sound 

source. 

1 1 . (original) The method of claim 1, fiorther comprising the step of 
transmitting the omnidirectional image via the Internet 

12. (original) The method of claim 11, wherein the transmitting step is 
conducted through a server that receives the omnidirectional image and transmits the 
omnidirectional image to at least one client. 

13. (original) The method of claim 1 , further comprising the step of forming a 
two-way transmission link between the image sensor and a remote display, wherein the two- 
way transmission link transmits at least one of the omnidirectional image, the perspective 
viewing window, and an audio signal. 
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1 4. (previously presented) An improved imaging apparatus for generating a two- 
dimensional image, comprising; 

a reflective mirror configured to satisfy an optical single viewpoint constraint for 
reflecting an image scene; 

an image sensor responsive to said reflective mirror and that generates two 
dimensional image data signals to obtain an omnidirectional image on an image plane; and 

a controller coupled to the image sensor, wherein the controller defines a perspective 
viewing window based on configuration parameters and maps pixels from said 
omnidirectional image into said perspective viewing window; and 

a memory for storing a mapping matrix for each of a plurality of sets of said 
configuration parameters in a parameter space, said controller using a said mapping matrix to 
perform mapping of pixels from said omnidirectional image into said perspective viewing 
window. 

15. (cancelled). 

16. (original) The improved imaging apparatus of claim 14, wherein the 
reflective mirror creates a one-to-one correspondence between pixels in the omnidirectional 
image and pixels in the perspective viewing window. 

17. (original) The improved imaging apparatus of claim 14, wherein the 
controller maps the omnidirectional image to the perspective viewing window by mapping 
each pixel in the perspective viewing window with a corresponding pixel value in the 
omnidirectional image. 
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18. (original) The improved imaging apparatus of claim 14, wherein the 
parameters defining the perspective viewing window include at least one of a zoom distance 
defined as the distance from the focal point of said reflective mirror to said window, a pan 
angle defined as the angle between the x axis and a line through the focal point of said 
reflective mirror perpendicular to the x-y plane and a tilt angle defined as the angle between 
the x-y plane and a vector normal to the perspective viewing window. 

19. (original) The improved imaging apparatus of claim 1 8, further 
comprising a user interface through which a user enters data corresponding to at least one of a 
desired zoom distance, pan angle, or tilt angle. 

20. (previously presented)The improved imaging apparatus of claim 14, wherein 
the controller generates a mapping matrix by applying a ray tracing algorithm to each pixel in 
the perspective viewing window to determine a corresponding reflection point on the 
reflective mirror and then projecting each reflection point to a focal point of the image sensor 
to determine the corresponding location on the omnidirectional image. 

21 . (original) The improved imaging apparatus of claim 1 4, wherein the 
perspective viewing window is a panoramic viewing window. 

22. (previously presented) The improved imaging apparatus of claim 14, further 
comprising a module having a memory for storing a mapping matrix. 
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23. (original) The improved imaging apparatus of claim 22, wherein the 
module is a display/meniory/local control module. 

24. (original) The improved imaging apparatus of claim 14, wherein the 
controller calculates a residual image based on a difference between a reference 
omnidirectional image and a sequential omnidirectional image to detect an anomaly and uses 
the anomaly to calculate parameters for the perspective viewing window so that the 
perspective viewing window focuses on the anomaly, 

25. (original) The improved imaging apparatus of claim 24, further 
comprising an alarm that is activated if at least a portion of the residual image exceeds a 
predetermined threshold. 

26. (original) The improved imaging apparatus of claim 14, further 
comprising an acoustic sensor coupled to the controller for detecting a sound source within 
the image scene, wherein the controller adjusts the perspective viewing window based on a 
location of the sound source. 

27. (original) The improved imaging apparatus of claim 14, fbrther 
comprising an image transmission system for transmitting the omnidirectional image via the 
Internet. 
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28. 



(original) 



The improved imaging apparatus of claim 27, wherein the 



image transmission device includes a server that receives the omnidirectional image and 
transmits the omnidirectional image to at least one client. 

29. (previously presented) The improved imaging apparatus of claim 14, further 
comprising: 

a remote display coupled to the image sensor, 
a first speaker and first microphone coupled to the image sensor; and 
a second speaker and second microphone coupled to the remote display, wherein the first and 
second speakers and first and second microphones form a two-way transmission link between 
the image sensor and the remote display. 

30. (previously presented) The improved imaging apparatus of claim 1 4, wherein 
said reflective mirror is a hyperbolic mirror having a hyperbolic cross-section, 

3 1 . (previously presented) An imaging apparatus for generating a two-dimensional 
image, comprising: 

a reflective hyperbolic mirror having a hyperbolic cross-section; 

an image sensor optically coupled to said reflective mirror that generates two- 
dimensional image data signals based on an omnidirectional image reflected by said mirror; 
and 

a controller coupled to the image sensor, wherein the controller defines a perspective 
viewing window based on configuration parameters and maps pixels from said 
omnidirectional image into said perspective viewing window; and 
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a memory for storing a mapping matrix for each of a plurality of sets of said 
configuration parameters in a parameter space > said controller using a said mapping matrix to 
perform mapping of pixels from said omnidirectional image into said perspective viewing 
window. 

32. (previously presented) The imaging apparatus of claim 3 1 , wherein the 
reflective mirror creates a one-to-one correspondence between pixels in the omnidirectional 
image and pixels in the perspective viewing window, 

33 . (previously presented) The imaging apparatus of claim 3 1 , wherein the 
controller maps the omnidirectional image to the perspective viewing window by mapping 
each pixel in the perspective viewing window with a corresponding pixel value in the 
omnidirectional image. 

34- (previously presented) The imaging apparatus of claim 14, wherein parameters 
defining the perspective viewing window include at least one of a zoom distance defined as 
the distance from the focal point of said reflective mirror to said window, a pan angle defined 
as the angle between the x axis and a line through the focal point of said reflective mirror 
perpendicular to the x-y plane and a tilt angle defined as the angle between the x-y plane and 
a vector normal to the perspective viewing window. 

35. (previously presented) The imaging apparatus of claim 34, further comprising a 
user interface through which a user enters data corresponding to at least one of a desired 
zoom distance, pan angle, or tilt angle. 
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36. (previously presented) The imaging apparatus of claim 31, wherein the 
controller generates a mapping matrix by applying a ray tracing algorithm to each pixel in the 
perspective viewing window to determine a corresponding reflection point on the reflective 
mirror and then projecting each reflection point to a focal point of the image sensor to 
determine the corresponding location on the omnidirectional image. 

37. (previously presented) The imaging apparatus of claim 31, wherein the 
perspective viewing window is a panoramic viewing window* 

3 8. (previously presented) The imaging apparatus of claim 3 1 s wherein said 
memory contains a predetermined mapping matrix for every set of configuration parameters 
in said parameter space. 

39. (previously presented)The imaging apparatus of claim 3 1 , wherein the 
controller calculates a residual image based on a difference between a reference 
omnidirectional image and a sequential omnidirectional image to detect an anomaly and uses 
the anomaly to calculate parameters for the perspective viewing window so that the 
perspective viewing window focuses on the anomaly. 

40, (previously presented) The imaging apparatus of claim 39, further comprising 
an alarm that is activated if at least a portion of the residual image exceeds a predetermined 
threshold. 
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41 . (previously presented) Hie imaging apparatus of claim 31, further comprising 
an acoustic sensor coupled to the controller for detecting a sound source within a scene of 
said omnidirectional image reflected by said mirror, wherein the controller adjusts the 
perspective viewing window based on a location of the sound source. 

42. (previously presented) The imaging apparatus of claim 31 , further comprising 
an image transmission system for transmitting image output by said image sensor via the 
Internet. 

43 . (previously presented) The imaging apparatus of claim 3 1 , further comprising : 
a remote display coupled to the image sensor; 

a first speaker and first microphone coupled to the image sensor; and 
a second speaker and second microphone coupled to the remote display, 
wherein the first and second speakers and first and second microphones form a two- 
way transmission link between the image sensor and the remote display, 

44. (previously presented) The imaging apparatus of claim 3 1 , wherein 

each said mapping matrix is configured to reduce distortion during mapping of each 
pixel in the perspective viewing window with a corresponding pixel from said 
omnidirectional image. 
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